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DETAILED ACTION 

Claim Rejections -35 USC § 103 
The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

Claims 1-3 and 14-16 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Komissarchik et al (US Patent No. 5,799,276) in view of Nojima (EP 1013222 Al). 

Regarding claims 1-3, Komissarchik et al, with the invention for knowledge-based 
speech recognition system and methods having frame length computed based upon estimated 
pitch period of vocalic intervals, read on every feature of the claim for dynamic personalized 
reading instruction where words meeting a confidence/recognition level are displayed above a 
"line" and words failing to meet the level are displayed "below", as follows: 
Komissarchik et al read on the step of determining; a first word recognition level (column 16 
lines 13-17); 

Komissarchik et al read on the step of displaying words based on the determined word 
recognition level from a set of words classified by word recognition levels (20 in figure 2); 
Komissarchik et al read on the step of determining word recognition errors based on 

comprehension of a word (below the confidence level - see column 16 lines 18-22); 
Komissarchik et al read on the step of determining a second word recognition level based on the 
determined word recognition errors (with the ranking illustrated in 23, figure 2 - see column 15 
lines 41-44 as taught in column 4 line 42). 



Application/Control Number: 09/987,420 Page 3 

Art Unit: 2654 

Komissarchik does not teach determining errors based on user comprehension using at 
least one comprehension aid provided to the user. However, refer to Nojima (EP101322 Al) 
who teach presenting a cartoon (a plurality of pictures or aspects) to a user (page 3, lines 13-16), 
prompting the user to provide a description of the contents of the picture (page 5, lines 33-63) 
wherein the description of the aspects is in a sentence structure and determining if the user 
provided description accurately describes the picture (page 6, lines 24-51). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Komissarchik to provide for comprehension exercises to the user, as 
suggested by Nojima, for the purpose of improving the students comprehension abilities and 
reading vocabulary. 

Regarding claims 14-16, Komissarchik et al read on every feature of the claim for 
dynamic personalized reading instruction as follows: 

- Komissarchik et al read on the feature of a controller (in the CPU 14 in figure 1); 

- Komissarchik et al read on the feature of a memory (17 in figure 1) for storing words and 
comprehension aids classified by word recognition levels (inherently relevant to the word 
confidence levels of column 8 lines 16-17 - see column 16 lines 18-22); 

- Komissarchik et al read on the feature of a word recognition level determining circuit for 
determining a word recognition level (column 16 lines 13-17); 

- Komissarchik et al read on the feature of a word display circuit for displaying words (20 in 
figure 2) from the stored words based on the determined word recognition level; 
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- Komissarchik et al read on the feature of a recognition error determining circuit for 
determining recognition errors (column 16 lines 18-22); 

- Komissarchik et al read on the feature of a comprehension aid display circuit for displaying 
comprehension aids based on determined recognition errors (22 figure 2); 

- Komissarchik et al read on the feature of a word recognition level adjusting circuit adjusting 
the word recognition level based on the determined recognition errors (inherently enabling 
the ranking illustrated in 23, figure 2 - see column 15 lines 4144 as taught in column 4 line 
42). 

Komissarchik does not teach determining errors based on user comprehension using at 
least one comprehension aid provided to the user. However, refer to Nojima (EP101322 Al) 
who teach presenting a cartoon (a plurality of pictures or aspects) to a user (page 3, lines 13-16), 
prompting the user to provide a description of the contents of the picture (page 5, lines 33-63) 
wherein the description of the aspects is in a sentence structure and determining if the user 
provided description accurately describes the picture (page 6, lines 24-51). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Komissarchik to provide for comprehension exercises to the user, as 
suggested by Nojima, for the purpose of improving the students comprehension abilities and 
reading vocabulary. 

Claims 28 and 30 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Rtischev et al (US Patent No. 5,634,086) in view of Nojima (EP 101322 Al). 
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Regarding claims 28 and 30, Rtischev et al. with the invention for voice interactive 
language instruction, read on the features of a carrier wave encoded to transmit a control 
program (an inherent characteristic of the DSP device, column 3 line 66) usable for dynamic 
personalized reading instruction to a device for executing the control program (disclosed in 
column 4 lines 48-58) including instructions and, specific to claim 30, a computer readable 
program code embodied on the computer readable storage medium (34 in figure 1& 42-48 in 
figure 2 - see column 4 line 63 to column 5 line 2) to perform dynamic personalized reading 
instruction as follows: - Rtischev et al read on the feature of instructions for determining a 1st 
word recognition level (AJ in figure 4B). - Rtischev et al r ead on the feature of instructions for 
displaying words (video, column 3 line 5) based on the determined word recognition level 
(column 3 lines 60-65) from a set of words classified by word recognition levels. - Rtischev et al 
read on the feature of instructions for determining word recognition errors based on 
comprehension of a word (by recognizing reading errors in column 3 line 43) and instructions 
for determining a 2"d word recognition level based on the determined word recognition errors 
(i.e., any other one of the three levels of error tolerance column 3 line 39). 

Rtischev et al does not teach determining errors based on user comprehension using at 
least one comprehension aid provided to the user. However, refer to Nojima (EP101322 Al) 
who teach presenting a cartoon (a plurality of pictures or aspects) to a user (page 3, lines 13-16), 
prompting the user to provide a description of the contents of the picture (page 5, lines 33-63) 
wherein the description of the aspects is in a sentence structure and determining if the user 
provided description accurately describes the picture (page 6, lines 24-51). 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Rtischev to provide for comprehension exercises to the user, as 
suggested by Nojima, for the purpose of improving the students comprehension abilities and 
reading vocabulary. 

Rtischev and Nojima do not teach the first word recognition level being dynamically 
adjusted. However, it would have been obvious toj provide for dynamic adjustment of a first 
word recognition level so as to provide recognition level settings based on user profiles or 
previous user testing. 

Claims 4-5 and 17-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Komissarchik et al in view of Nojima and further in view of Carlgren et al (U.S. Patent 
4,456,973 A). 

Regarding claims 4-5 and 17-18; the claims are set forth with the same limitations as 
claims 3 and 16, respectively. Komissarchik et al does not speak to comprehension aids. 
Carlgren et al read on the feature where the comprehension aid is a human sensible explanation 
of the concept of at least one classified word (in this case, by providing synonyms in column 5 
lines 45-49). 

Regarding claims 5 and 18 as understood by the Examiner; the claims are set forthwith 
the same limitations as claims 4 and 17, respectively. Komissarchik et al does not speak to 
comprehension aids, Carlgren et al read on the feature where the human sensible explanation of 
the concept is at ieast one of a graphic icon, an animation, audio information, and video 
information (43 & 44 in figure 5). 
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Claims 6-12 and 19-25 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Burstein et al (U.S. Patent 6,366,759 Bl) in view of Carlgren et a and further in view of Nojima. 

Regarding claims 6 and 19 as understood by the Examiner, Burstein et al , with the invention 
for computer-based automatic essay scoring, read on the features of dynamic personalized 
reading instruction as follows: - Burstein et al r ead on the step of determining a text (essay, in 
column 7 lines 1-3); - Burstein et al teach the step of analyzing the text based on a theory of 
discourse analysis (column 1 lines 59-64); - Burstein et al read on the step of determining a 1 s~ 
user reading level (i.e., class in column 7 lines 7-9); 

- Burstein et al teach on the step of displaying a grammatical tunable text summary (using 
grammar checker variables column 2 lines 20^28) based on the determined reading level 
(i.e., essay scoring in column 2 lines 38-43); ■ 

Burstein does not teach using at least one comprehension aid provided to the user. 
However, refer to Nojima (EP101322 Al) who teach presenting a cartoon (a plurality of pictures 
or aspects) to a user (page 3, lines 13-16), prompting the user to provide a description of the 
contents of the picture (page 5, lines 33-63) wherein the description of the aspects is in a 
sentence structure and determining if the user provided description accurately describes the 
picture (page 6, lines 24-51). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention to 
modify the system of Burstein to provide for comprehension exercises to the user, as suggested 
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by Nojima, for the purpose of improving the students comprehension abilities and reading 
vocabulary. 

- Burstein et al recognize the role of determining comprehension (column 1 lines 5966), but 
do not explicitly teach its use as do Carlgren et al who read on the step of determining 
comprehension of the text (column 5 lines 39-44); and 

- Carlgren et al further read on the step of determining a further user reading levels based on 
the comprehension and reading level (with the step of applying synonyms whose grade level 
is exceeded, column 5 lines 60-63). 

- It would have been obvious to a person of ordinary skill in the art of speech signal 
processing at the time of the invention to apply the method/teachings of Carlgren et al to the 
device/method of Burstein et al so as to keep suggestions compatible with the associated 
materials. 

- Regarding those features particular to claim 19, Burstein et al disclose the physical features 
of a memory and circuits enabling input/output and the features cited above (claim 17 lines 
32-42) 

Regarding claims 7 and 20, the claims are set forth with the same limitations as 
claims 6 and 19, respectively. Burstein et al do not speak to displaying salient information. 
Carlgren et al read on the step of displaying salient information from the grammatical tunable 
text summary based on at least one of - a user request (42 in figure 5), determined reading 
speed, and determined comprehension level It would have been obvious to a person of ordinary 
skill in the art of speech signal processing at the time of the invention to apply the 
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method/teachings of Carlgren et al to the device/method of Burstein et al s o that suggestions 
agree with the criteria that was used to decide the need for further display. 

Regarding claims 8 and 21 ; the claims are set forth with the same limitations as claims 7 
and 19, respectively. Burstein et al teach the feature where the text is analyzed based on the 
Discourse Structures Theory, Linguistic Discourse Model, Rhetorical Structure Theory (column 
1 line 57), Systemic Functional Grammar, or Tagmemics. 

Claims 9-12 and 22-25 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Burstein et al in view of Carlgren et al and Nojimd _and further in view of Komissarchik et al . 

Regarding claim 9 as understood by the Examiner and claim 22, the claims are set forth 
with the same limitations as claims 7 and 19, respectively. The features of the claims are the 
same as those found in claim 2 and the claims are rejected for the same reasons. 

Regarding claims 10 and 23, the claims are set forth with the same limitations as claims 

9 and 22, respectively. The features of the claims are the same as those found in claim 6 and the 
claims are rejected for the same reasons. 

Regarding claims 1 1 and 24, the claims areiset forth with the same limitations as claims 

10 and 23, respectively. The features of the claims are the same as those found in claim 4 and the 
claims are rejected for the same reasons. 
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Regarding claims 12 and 25 as understood by the Examiner, the claims are set forth with 
the same limitations as claims 1 1 and 24, respectively. The features of the claims are the same as 
those found in claim 5 and the claims are rejected for the same reasons. 

Regarding claim 13, Komissarchik et al read on the features of the claim for combined word 
and sentence level dynamic personalized reading instruction as follows: 
- Komissarchik et al read on the feature of providing word level dynamic personalized 

instruction (22 in figure 2): 

Komissarchik et al read on the step of determining a ISt word recognition level (column 16 
lines 13-17); Komissarchik et al read on the step of displaying words based on the determined 
word recognition level from a set of words classified by word recognition levels (20 in figure 
2); Komissarchik et al read on the step of determining word recognition error based on 
comprehension of a word (below the confidence level - see column 16 lines 18-22); 
Komissarchik et al read on the features of providing sentence level dynamic personalized 
instruction (column 8 line 13) but does not speak to a second or further recognition level. 
Komissarchik does not teach determining errors based on user comprehension using at 
least one comprehension aid provided to the user. However, refer to Nojima (EP101322 Al) 
who teach presenting a cartoon (a plurality of pictures or aspects) to a user (page 3, lines 13-16), 
prompting the user to provide a description of the contents of the picture (page 5, lines 33-63) 
wherein the description of the aspects is in a sentence structure and determining if the user 
provided description accurately describes the picture (page 6, lines 24-51). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention to 
modify the system of Komissarchik to provide for comprehension exercises to the user, as 
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suggested by Nojima, for the purpose of improving the students comprehension abilities and 
reading vocabulary. 

Carlgren et al read on the step of determining a 2"d word recognition level based on the 
determined word recognition errors (with the step of applying synonyms whose grade level is 
exceeded, column 5 lines 60-63). Burstein et al read on the step of determining a text (essay, 
in column 7 lines 1-3); Burstein et al teach the step of analyzing the text based on a theory of 
discourse analysis (column 1 lines 59-64); Burstein et al read on the step of determining a 1st 
user reading level (i.e., class in column 7 lines 7-9); Burstein et al teach the step of displaying 
a grammatical tunable text summary based on the determined reading level (using grammar 
checker variables, column 2 lines 20-28) 
Burstein et al recognize the role of determining comprehension (column 1 lines 59-66), but 
do not explicitly teach its use as do Carlgren et al who read on the step of determining 
comprehension of the text (column 5 lines 39-44); and 

Carlgren et al further read on the step of determining a 2"d user reading level based on the 
comprehension and reading level (with the step of applying synonyms whose grade level is 
exceeded, column 5 lines 60-63). 

It would have been obvious to a person of ordinary skill in the art of speech signal 
processing at the time of the invention to apply the method/teachings of Carlgren et al to the 
device/method of Komissarchik et al to keep the discourse of a text in line with the associated 
words, and it would have been obvious to a person of ordinary skill in the art of speech signal 
processing at the time of the invention to apply the method/teachings of Burstein et al to the 
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device/method of Komissarchik et al and Calgren et al to identify problems with understanding 
that do not arise from word misrecognition. 

Claims 26 and 27 are rejected under 35 U.S. C. 103(a) as being unpatentable over 
Carlgren et al in view of Komissarchik et al and further in view of Nojima and further in view of 
Rtischev et al (U.S. Patent 5,634,086 A). 

Regarding claim 26, Carlgren et al read on the features of the claim for combined word 
and sentence level dynamic personalized reading instruction as follows: 

Carlgren et al further read on the feature of word level dynamic personalized instruction (column 
3 line 41) and a controller (column 3 line 37); a memory for storing words (column 2 line 23), 
comprehension aids classified by word recognition levels and a text (column 1 lines 30-37); 
Carlgren et al further read on the feature of a word recognition level determining circuit for 
determining a. word recognition level (column 1 lines 36-37) and a word display circuit for 
displaying words from the stored words based on the determined word recognition level (column 
1 line 40); Carlgren et al does not, speak to recognition errors. Komissarchik et al read on the 
feature of a recognition error determining circuit for determining recognition errors (column 17 
lines 2-5) and a comprehension aid display circuit for displaying comprehension aids based on 
determined recognition errors (20 in figure 2). 

It would have been obvious to a person of ordinary skill in the art of speech signal 
processing at the time of the invention to apply the method/teachings of Komissarchik et al to the 
device/method of Carlgren et al so as to decrease the error rate for frequent words. 



Application/Control Number: 09/987,420 Page 13 

Art Unit: 2654 

Carlgren does not teach using at least one comprehension aid provided to the user to 
determine user recognition errors. However, refer to Nojima (EP101322 Al) who teach 
presenting a cartoon (a plurality of pictures or aspects) to a user (page 3, lines 13-16), prompting 
the user to provide a description of the contents of the picture (page 5, lines 33-63) wherein the 
description of the aspects is in a sentence structure and determining if the user provided 
description accurately describes the picture (page 6, lines 24-51). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Carlgren to provide for comprehension exercises to the user, as 
suggested by Nojima, for the purpose of improving the students comprehension abilities and 
reading vocabulary. 

Neither Carlgren et al nor Komissarchik et al mention adjusting word recognition based 
on errors. Rtischev et al with the invention for voice-interactive language instruction, disclose 
the feature of a word recognition level adjusting circuit adjusting the word recognition level 
based on the determined recognition errors (AJ~>AN in figure 4B - see column 3 lines 38-40). 
It would have been obvious to a person of ordinary skill in the art of speech signal processing at 
the time of the invention to apply the method/teachings of Rtischev et al to the device/method of 
Carlgren or Komissarchik et al to keep the system from being annoying to use by employing a 
level of patience that simulates natural human-based interaction. Carlgren et al teach the feature 
of sentence level dynamic personalized instruction circuit (column 1 lines 19-24); an 
input/output circuit for loading a selected text into the memory (column 2 lines 23-24) but does 
not stipulate discourse analysis. Burstein et al teach the feature of a discourse analysis circuit for 
analyzing the text (column 1 lines 59-64) and on the feature of a grammatical tunable text 
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summary generating circuit for determining a grammatical tunable text summary of the analyzed 
text (using grammar checker variables column 2 lines 20-28); Carlgren et al read on the feature 
of a text determining circuit for determining display text based on a determined reading level 
information (column 1 lines 36-37 & 40); Carlgren et al does not mention interactive 
questioning. 

Rtischev et al disclose the feature of a comprehension question generating circuit for 
generating comprehension questions (column 3 lines 15-17 & 45-48) based on the grammatical 
tunable text summary (in this case, being expected to match the target language of column 3 line 
18) and on the feature of a controller for determining a new reading level (i.e., one of the 4 levels 
or states in column 3 lines 46-48) based on at least one of the determined comprehension and 
reading speed (with the pauses T in figure 4A2 & AH— >AJ in figure 4B). 

It would have been obvious to a person of ordinary skill in the art of speech signal 
processing at the time of the invention to apply the; method/teachings of Rtischev et al to the 
device/method of Carlgren et al s o as to monitor the dialogue to be within the parameters of the 
using audience. 



Claims 29 and 31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Carlgren et al in view of Nojima and further in view of Burstein et al 

Regarding claims 29 and 31, Carlgren et al read on the features of the claims for 
a carrier wave encoded to transmit a control program usable for dynamic personalized 
reading instruction to a device for executing the control program (column 3 lines 28-35) 
and for a computer readable storage medium, comprising a computer readable program 
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code embodied on the computer readable storage medium, the computer readable 
program code usable to program a computer to perform dynamic personalized reading 
instruction (column 2 lines 23-25) as follows: 

Carlgren et al read on the feature of instructions for determining a text (column 2 lines 
30-31); 

Carlgren et al does not mention using a theory of discourse analysis. Burstein et al teach the 
feature of analyzing the text based on a theory of discourse analysis (column 1 lines 59-64); 

Carlgren et al disclose a target grade level but do not speak to instructions for 
determining user comprehension. However, refer to Nojima (EP101322 Al) who teach 
presenting a cartoon (a plurality of pictures or aspects) to a user (page 3, lines 13-16), prompting 
the user to provide a description of the contents of the picture (page 5, lines 33-63) wherein the 
description of the aspects is in a sentence structure and determining if the user provided 
description accurately describes the picture (page 6, lines 24-51). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention to 
modify the system of Carlgren to provide for comprehension exercises to the user, as suggested 
by Nojima, for the purpose of improving the students comprehension abilities and reading 
vocabulary. 

Burstein et al teach the feature of instructions for displaying a grammatical tunable text 
summary based on the determined reading level (using grammar checker variables, column 2 
lines 20-28). 
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Burstein et al recognize the role of determining comprehension (column 1 lines 5966), but 
do not explicitly teach its use as do Carlgren et al who read on the step of instructions for 
determining comprehension of the text (column 5 lines 39-44); and 

Carlgren et al further read on the step of instructions for determining a further user reading 
levels based on the comprehension and reading level (with the step of applying synonyms whose 
grade level is exceeded, column 5 lines 60-63). 

It would have been obvious to a person of ordinary skill in the art of speech signal 
processing at the time of the invention to apply the : method/teachings of Burstein et al to the 
device/method of Carlgren et al to address mis-recognition based on word understanding rather 
than to rely on the mechanics of word matching and selection. 

Response to Arguments 
Applicant's arguments with respect to claims 1-31 have been considered but are moot in 
view of the new ground(s) of rejection. 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
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the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 571-272-7598. 
The examiner can normally be reached on Monday-Thursday 1 1:30-8:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on 571-272-7602. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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Primary Examiner 
Art Unit 2654 
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